Home->Research->Intelligent Video Computing for Automated Construction Operation Productivity Analysis

 

Intelligent Video Computing for Automated Construction Operation Productivity Analysis

My dissertation involved the development of video intelligence models for automated productivity analysis of construction activities. Gathering data for improving on-site operations is an essential and difficult task in construction. Among other things, video taping has long been used in construction to analyze construction operations. And recently, construction webcams have been increasingly used in construction projects for jobsite monitoring, providing live streams of visual information on ongoing construction activities. However, in the absence of an efficient video interpretation method, tedious manual reviewing is currently still required to extract productivity information from those videos. My research investigates intelligent computing methods for automated construction video analysis. The core of this research is to develop a generic computer-based video interpretation model that can interpret the live streams of visual information about ongoing construction activities and extract productivity information automatically at the level of human intelligence. The success of this research can greatly facilitate productivity data collection and real-time construction operation state intelligence. As a proof of concept, I have developed a model-based system that combines techniques from the areas of construction process modeling and simulation, construction productivity analysis, computer vision, and pattern recognition. The results demonstrated the feasibility and effectiveness of the proposed approach.

 

Research Motivation and Literature Review

Research Motivation: The Need for Data Collection Methods

 

Research Motivation: Current Data Collection Method

 

Research Motivation: Video Applications for Construction Management

 

Research Motivation: Video Hardware In Netshell

Research Methodology

Data Collection Paradigm

 

Overall Approach

 

Mapping Manual Based Video Analysis To Computer Based Video Interpretation

 

Video Context and Construction Domain Knowledge Taxonomy

 

A Generic Hierarchical Video Interpretation Model

 

A Developed Software System: Construction Site Vision Workbench

 

Case Study: Concrete Column Pour Application

Model Based Concrete Column Pour Video Interpretation

 

Process Model Driven Video Context Setup

 

Bucket Detection Using Cascaded Simple Haar Features

 

Column Pour Video Interpretation In Process

 

Graphic Comparison Between Ground Truth and Interpretation Results

Quantitative Summary of Video Interpretation Results

 

Cycle 1
(minutes)

State Time
Accuracy

Cycle 2
(minutes)

State Time
Accuracy

Cycle 3
(minutes)

State Time
Accuracy

 

G

P

 

G

P

 

G

P

 

Load Ready

0

0

 

0

0

 

0

0

 

Bucket Ready

0

0

 

9.72*

9.733*

99.9%

0.72

1.1

65%

Pour Column 1

0

0

 

0

0

 

0

0

 

Pour Column 2

3.65

3.67

99.5%

0

0

 

4.17*

4.033*

96.7%

Load Bucket

0

0

 

5

5.1

98%

10.8*

10.97*

98.5%

Bucket Departing

0.27

0.183

68%

0.167^

0.10^

60%

0.28

0.154

55%

Cycle Length Accuracy

98.3%

99.8%

99.5%

 

Cycle 4
(minutes)

State Time
Accuracy

Cycle 5
(minutes)

State Time
Accuracy

Cycle 6
(minutes)

State Time
Accuracy

 

G

P

 

G

P

 

G

P

 

Load Ready

0

0

 

0

0

 

0

0

 

Bucket Ready

7.02*

6.97*

99.3%

2.83

2.47

87%

1

1.07

93.5%

Pour Column 1

0

0

 

4.33*

4.23*

97.7%

2.83

2.81

99.3%

Pour Column 2

3.83

3.73

97.4%

4.33*

4.43*

97.7%

0

0

 

Load Bucket

3.67

3.7

99.2%

3.58

4.13

86.7%

3.83

4.13

92.7%

Bucket Departing

0.27

0.208

77%

0.25

0.22

88%

0.5

0.253

51%

Cycle Length Accuracy

98.8%

99%

97.7%

Interpretation Result

 

 

 

 
Last Updated by Jie Gong On October 17, 2008